OpenStack Newton : Use Cinder Storage (GlusterFS)
2016/11/20 |
It's possible to use Virtual Storages provided by Cinder
if an Instance needs more disks.
Configure Virtual storage with GlusterFS backend on here.
+------------------+ +------------------+ 10.0.0.50| [ Storage Node ] | 10.0.0.61| | +------------------+ +-----+ Cinder-Volume | +-----+ GlusterFS #1 | | [ Control Node ] | | eth0| | | eth0| | | Keystone |10.0.0.30 | +------------------+ | +------------------+ | Glance |------------+------------------------------+ | Nova API |eth0 | +------------------+ | +------------------+ | Cinder API | | eth0| [ Compute Node ] | | eth0| | +------------------+ +-----+ Nova Compute | +-----+ GlusterFS #2 | 10.0.0.51| | 10.0.0.62| | +------------------+ +------------------+ |
[1] |
GlusterFS server is required to be running on your LAN, refer to here.
This example uses a replication volume "vol_replica" provided by "glfs01" and "glfs02". |
[2] | Configure Storage Node. |
root@storage:~#
apt-get -y install glusterfs-client
root@storage:~#
vi /etc/cinder/cinder.conf # add follows in the [DEFAULT] section enabled_backends = glusterfs # add follwos to the end [glusterfs] volume_driver = cinder.volume.drivers.glusterfs.GlusterfsDriver glusterfs_shares_config = /etc/cinder/glusterfs_shares glusterfs_mount_point_base = $state_path/mnt_gluster
root@storage:~#
vi /etc/cinder/glusterfs_shares # create new: specify GlusterFS volumes glfs01.srv.world:/vol_replica chmod 640 /etc/cinder/glusterfs_shares root@storage:~# chgrp cinder /etc/cinder/glusterfs_shares root@storage:~# systemctl restart cinder-volume |
[3] | Configure Compute Node to mount GlusterFS volume. |
root@node01:~#
apt-get -y install glusterfs-client
root@node01:~#
vi /etc/nova/nova.conf # add to the end [cinder] os_region_name = RegionOne systemctl restart nova-compute |
[4] | For example, create a virtual disk "disk01" with 10GB. It's OK to work on any node. (This example is on Control Node) |
# set environment variable first root@dlp ~(keystone)# echo "export OS_VOLUME_API_VERSION=2" >> ~/keystonerc root@dlp ~(keystone)# source ~/keystonerc
openstack volume create --size 10 disk01 +---------------------+--------------------------------------+ | Field | Value | +---------------------+--------------------------------------+ | attachments | [] | | availability_zone | nova | | bootable | false | | consistencygroup_id | None | | created_at | 2016-11-22T07:43:25.830543 | | description | None | | encrypted | False | | id | 677151dc-91d2-47c2-864b-f9d457a0081e | | migration_status | None | | multiattach | False | | name | disk01 | | properties | | | replication_status | disabled | | size | 10 | | snapshot_id | None | | source_volid | None | | status | creating | | type | None | | updated_at | None | | user_id | b48cbdf1975f4fd3987f83a100cc9162 | +---------------------+--------------------------------------+root@dlp ~(keystone)# openstack volume list +------------------------------+--------------+-----------+------+-------------+ | ID | Display Name | Status | Size | Attached to | +------------------------------+--------------+-----------+------+-------------+ | 677151dc-91d2-47c2-864b- | disk01 | available | 10 | | | f9d457a0081e | | | | | +------------------------------+--------------+-----------+------+-------------+ |
[5] | Attach the virtual disk to an Instance. For the exmaple below, the disk is connected as "/dev/vdb". It's possible to use it as a storage to create a file system on it. |
root@dlp ~(keystone)# openstack server list +--------------------+-------------+---------+--------------------+------------+ | ID | Name | Status | Networks | Image Name | +--------------------+-------------+---------+--------------------+------------+ | 94afe31b-659b-4f61 | Ubuntu_1604 | SHUTOFF | int_net=192.168.10 | Ubuntu1604 | | -bfd4-380bf440b510 | | | 0.9, 10.0.0.207 | | +--------------------+-------------+---------+--------------------+------------+
root@dlp ~(keystone)#
openstack server add volume Ubuntu_1604 disk01
# the status of attached disk turns "in-use" like follows root@dlp ~(keystone)# openstack volume list +-----------------------+--------------+--------+------+-----------------------+ | ID | Display Name | Status | Size | Attached to | +-----------------------+--------------+--------+------+-----------------------+ | 677151dc-91d2-47c2 | disk01 | in-use | 10 | Attached to | | -864b-f9d457a0081e | | | | Ubuntu_1604 on | | | | | | /dev/vdb | +-----------------------+--------------+--------+------+-----------------------+ |